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Abstract 

We consider dynamic cooperative games, where the worth of coahtions varies 
over time according to the history of allocations. When defining the core of 
a dynamic game, we allow the possibility for coalitions to deviate at any time 
and thereby to give rise to a new environment. A coalition that considers a de- 
viation needs to take the consequences into account because from the deviation 
point on, the game is no longer played with the original set of players. The 
deviating coalition becomes the new grand coalition which, in turn, induces a 
new dynamic game. The stage games of the new dynamical game depend on all 
previous allocation including those that have materialized from the deviating 
time on. 

We define three types of core solutions: fair core, stable core and credible 
core. We characterize the first two in case where the instantaneous game de- 
pends on the last allocation (rather than on the whole history of allocations) 
and the third in the general case. The analysis and the results resembles to a 
great extent the theory of non-cooperative dynamic games. 
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1 Introduction 

Noncooperative game theory has dedicated a lot of attention to dynamic games and 
refinements of Nash equihbrium have been studied to capture the features that the 
dynamic induces in the game. When the dynamic is obtained by simply repeating a 
stage game over time, the folk theorem shows that the set of equilibria in an infinitely 
repeated game is in general much larger than the set of equilibria in the stage game. 

In cooperative game theory most of the literature studies only static situations: a 
game is played only once and its solution is a set of suitable allocations that satisfies 
some conditions. 

In this paper we consider a bona fide dynamic version of a cooperative game, 
where the worth of coalitions varies over time according to the history of the game. 
In particular the worth of coalitions at time t depends on the allocations at all the 
times before t. 

When defining a solution concept we allow the possibility for coalitions to deviate 
at any time and thereby to give rise to a new environment. When a coalition deviates, 
from that point on, the game is no longer played with the original set of players. The 
deviating coalition becomes the new grand coalition which, in turn, induces a new 
dynamic game. The stage games of the new dynamical game depend on all previous 
allocations, including those that have materialized from the deviating time on. 

The existing literature on dynamic cooperative games considers games that deter- 
mine only the worth of any coalition in a stage game played with the original grand 
coalition. However, in order to accommodate the possibility of deviating coalitions 
that generate new dynamical games, we need a richer structure. In the model of 
dynamic cooperative games that we introduce, the grand coalition of any stage game 
might be strictly smaller than the original grand coalition, while the allocation history 
is adapted accordingly. 

In this paper we focus on dynamic games where the stage games are deterministi- 
cally determined by the historical allocations. In these games a sequence of allocations 
uniquely induces a sequence of stage games. We investigate the core in three different 
approaches. 

A coalition is said to be under-treated if the present value of its stage-shares is 
smaller than the present stage- worth of it. A sequence of stage- allocations is in the 
fair core if no sub-coalition is under-treated. Under the fair core approach, which 
is similar to that taken by the relevant literature, an under-treated coalition may 
complain but it cannot change the evolution of the game by abandoning the previous 
environment and creating a whole new game. 

In the stable core on the other hand, the share of a coalition is compared to the 
opportunities it would have if it decided to deviate. A coalition is said to be dissat- 
isfied with a sequence of allocations if, by quitting the original game, the coalition 
can form another dynamic game, with a smaller number of players, and afford better 
future allocations. A sequence of allocations is in the stable core if no coalition can 



deviate and get on its own a greater share than the one proposed by the sequence. 

The stable core does not consider what the threat of a potential deviating coalition 
consists of. It might be that the sequence of allocations a coalition shows in order to 
substantiate its dissatisfaction, is itself prone to deviations. Thus, a threat of a coali- 
tion to deviate and obtain a certain sequence of allocations may be non- sustainable 
and therefore non-credible. The credible core requires that any better sequence it 
might generate on its own be credible. That is, any sequence of future allocations 
must itself be immune to deviations of smaller sub-coalitions that are also immune 
to deviations of smaller coalitions. 

In all our analysis at every stage t, either no player deviates and therefore a game 
involving all the players of the previous stage t — 1 is played, or a coalition deviates 
and creates its own game, which is a subgame of the previous one. Players are never 
allowed to establish a larger coalition once they have deviated and formed a smaller 
one. So new games can be created by splitting, but not by aggregation. We make 
this assumption since, without it the possible dynamics would be so general as not 
to produce any interesting result. Moreover the assumption allows to describe a huge 
spectrum of situations of relevance. 

When a coalition 5* deviates from the grand coalition N, we do not take into 
account what happens to the coalition N\S. This is due to the fact that we are con- 
cerned with stability and therefore with conditions that guarantee that no deviation 
will actually materialize, no matter what the status of the abandoned coalition is. 

1.1 Existing literature 

Dynamic cooperative games have been studied i n a few versions. Most of the studies, 
as we do, concentrate on the core. lOviedd (120001 ) studies the core of a finitely repeated 



discounted cooperative game where the stage game does not vary over time and no 
dy namic consideration is involved. 



Kranich. Perea. and PetersI (|2005[ ) consider a finite horizon of predetermined games. 
They study three different core concepts. The classical core assumes that coalitions 
planning to split off do so right at the beginning. This concept does not depend on 
the temporal structure of the game: the classical core coincides with the core of an 
induced static game. The strong sequential core, on the other hand, allows for devi- 
ations of coalitions at any stage of the game, but once a coalition deviates at some 
point, it must keep doing so from that time on. In the above two concepts deviations 
are not required to be credible, i.e., they could be blocked by some sub-coalition in 
the future. The weak sequential core is robust against credible coalitional deviations. 
The latter means that deviations are immune to deviations of sub-coalitions. The 



sub-coalition deviations can be themselves non-credible. iHabis and Heringd (|2010[ ) 



pr ovide a correction of th e above definition of weak sequential core. 



Predtetchinskil ( 120071 ) deals with infinite-horizon stationary cooperative games. 



where at each moment the game is in one of a finite number of states, that determines 



which instantaneous game is played at that moment. The states evolves according to 
an exogenous Markov chain and it does not depend on past allocations. The author 
considers the classical core and a version of the strong sequ ential core , and provides 
conditions for nonemptyness of the strong sequential core. iHellmanI (120081 ) focuses 
on the bargaining set of dynamic cooperative games, where the sequence of stage 
TU-games is exogenously specified. 



Related results can be found in iGald (Il978l ). where a concept of sequential core 
is defined and is used to model lack of trust in a two -period economy. In this model 
coalitions are allowed to deviate in the second period. iBecker and Chakrabartil (119951 ) 
consider infinite horizon capital allocation models and define recursive core alloca- 
tions, the ones where no coalition can improve upon its consumption stream at any 
ti me given its accumula tion of assets up to that period. 



Koutsougerad (119981 ) introduces the notion of two-stage core, that takes into ac- 
count the possibility of temporary cooperation. Within each coalition agents make 
future trades only if they are enforceable, i.e., a coalition may have a limited horizon. 

Moreover a coalition blocks at some point in time only if it can secure improvements 

for its niembers in any possible consequence of a d eviation. jPredtetchinski. Herings. and Peters 
( I2OO2I ) ; iPredtetchinski. Herings. and Pereal ( 120061 ) use the concepts of strong and weak 
sequen tial core in the context of two-period economies. IPredtetchinski. Herings. and Peters 
(120041) applv t he concept of strong sequential core to a stationary exchange economy. 



PetrosjanI (Il977lll993|) deals with a cooper a tive g ame induced by a (non-cooperative 



differential game and JPetrosjan and Zaccourl (120031 ) study the problem of allocation 
over time of total cost incurred by countries in a cooperative game of pollution re- 
duction and compute the Shapley value of this game. These papers are not about 
dynamic cooperative games but about a cooperative game induced by non-cooperative 
game played over time. 

There exists a whole literature on coalition f ormation, where stability of coali- 



tions is considered under different aspects (see, e.g..lRavl.ll989HChw e. 1994t Xud. 11998 



nn 



Ray and Vohral Il999l : iKonishi and Rayl . 120031 : iDiamantoudi and Xue . ,20071 : iRayl . 120071 . 
and references therein). Typically this literature considers strategically richer mod- 
els than the one examined in this paper, so it is cl oser in spirit to nqncoop erative 
game theory. For instance the model considered by JKonishi and Rayl (120031 ). which 
describes coalition formation as a truly dynamical process, considers a state space, 
beliefs, a probabilistic structure, and equilibrium concepts. 



Our notion of credible core can be re lated to the papers by lBernheim. Peleg. and Whinston 



( 119871 ): iBernheim and WhinstonI (Il987l ) on coalition-proof Nash equilibria. 

In some of our results w e resort to the concept of e-core. This was introduced in 
Shapley and ShubikI ( 119661 ) to anal yze situat i ons where the core is empty. It has b een 
employed in different cont e xts bv IWooderd ( 19831): IShubik and Woodera (ll983aU bf) ; 
Wooders and Zamel (J1984 : iKovalenkov and WoodersI ( ]2001aU bl. l2003i boosi ). among 
others. In some of these papers a parametrized collection of cooperative games is 
considered and an approximate core is computed, where the goodness of the approx- 



iination depends on the parameters of the game. In particular, given the parameters 
TT describing a collection of games and given a lower bound n n on the number of play- 



ers in each game in the collection, iKovalenkov and WoodersI (J2001bl ) obtain a bound 



e(7r, no) so that, for any e > e{7i,no), all games in the collection with at least no 
players have nonempty £-cores. Some of our results have a similar flavor, except that 
for us the lower bound on the e is zero and the quantity that guarantees the existence 
of the e-core is the discount factor, rather than the number of players. 

The paper is organized as follows. In Section [2] we give a motivating example 
based on the classical market games of Shapley and Shubik. The model is introduced 
in [3] and the two first types of core solutions are given in Section HI Section [5] pro- 
vides characterizations of the non-emptyness of the e-core when the discount factor 
is sufficiently large. The credible core is discussed in Section [6] and the paper ends 
with a section devoted to a few final remarks. 

2 A motivating example: A market with external- 
ities 

To show a typical application of dynamic cooperative games consider n firms that 
engage repeatedly in a market game. At any period each firm brings into the mar- 
ket its own endowment and technology, that might depend on the firm's previous 
allocation. The firms then share their endowments in order to produce the maximal 
possible quantity. An important feature of the model is the existence of a positive 
externality refiected in the knowhow of each firm. The production function of each 
firm increases as the number of firms in the economy increases. 

Formally, let A^ = {1, 2, . . . , n} be the set of firms that are capable of producing a 
certain commodity using i production factors. In the static version of the model, when 
the input of production factors is y = {yi, . . . ,yi) G M^, firm i produces e{n)u\y), 
where u* is a concave function and e(n) is the externality factor which is increasing 
with the number n of firms in the economy. 

The relevance of the externality factor becomes clear in the dynamic model. An 
under-treated coalition of firms might want to split off and form its own consortium. 
By doing so, on one hand, as an independent consortium, it will be subject to a 
smaller externality factor, since the number of cooperating firms is reduced. On the 
other hand, it will have the full freedom to share the entire profit the way it wishes. 

To make the model more realistic, we assume that the production functions change 
over time and that, in order to keep the production ability, firms need to invest every 
period in maintenance, which requires resources. These resources come from the 
allocation of the firms in previous times, and whatever does not go into maintenance, 
is used for dividends. Thus, the current production function depends on yesterday's 
allocation and the externality factor. 



For instance, suppose that the production function of firm i at time t is 

uliy) = eik)^'/^'^<-M-iiy), (2.1) 

where k is the number of firms in the consortium that i belongs to, xl_i is the 
allocation of firm i at time t — 1, and < 7 < 1 is the decay rate per period. Note 
that ^i/(i+^t-i) is increasing with xl_i and therefore the greater the allocation at time 
t — 1, the more efficient the firm at time t. 

For the sake of simplicity assume that each firm is endowed anew at any time 
with the same production factor basket, say y\ We are ready now to describe the 
dynamic. If at time t firm i belongs to the consortium S, then it engages the stage 
market game vf defined by 

vf{T) = max[j2<{^y, E ^' = E^'' '' ^ ^+} 

for every T C S, with k = \S\ in ( 12. ip . 



3 Dynamic cooperative games 

3.1 Dynamic of the game 

Let N = {!,..., n} be the set of players. For any coalition SON consider a 
function f^ : 2'^ — t- ]R_|_ with v^{0) = 0. The function v^ is called characteristic 
function defined over S with the set S being the grand coalition of v^ . An allocation 
of v^ is a vector x^ E M"^ that satisfies Ylies ^^ (''') ~ v^{S) and x^{i) > B, where 
i? is a uniform lower bound over all allocations. The reason for this lower bound is 
primarily technical: with this lower bound the set of allocations becomes compact. If 
we take S = 0, no inter-temporal loans are allowed, whereas, when B < a player 
can get less than her individually rational level at a certain stage, but then she will 
be compensated in the future. 

At any stage t a cooperative games over a grand coalition S is played. Both the 
game and the grand coalition depend on the history up to that stage. The players 
of the grand coalition S are getting at time t an allocation of the game actually 
being played. The cooperative game of the subsequent period depends on the current 
allocation. 

Formally, a dynamic cooperative game is played over a discrete set of periods. The 
evolution of the system depends on the initial game, the allocation at every period 
and the dynamic V, specified below. At stage 1 any coalition decides whether to split 
off or not. If no coalition splits off, then the initial cooperative game v^ is played, 
and the allocation is x^ . If S splits off, then the initial cooperative game is ff and 
the allocation is xf. Note that the initial game is predetermined and is beyond the 
control of the players, unless a sub-coalition wishes to split off. 
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Like in a static cooperative game we will use (different versions of) the core to 
determine whether the grand coalition A^ is stable (in different senses), namely no 
sub-coalition S has an incentive to split. In case a coalition S can advantageously 
split, the grand coalition N is not stable, which makes the core empty. That is why 
we do not need to specify what payoffs players in N\S get or whether some of them 
want to form a coalition of their own. 

From period 2 on, the evolution is governed by V. The state of the system is 
a pair {S;x'^), where 5* is a coalition and x'^ is an allocation of S. As long as no 
coalition splits off, the state is of the form (A^; x^); once a coalition S ^ N deviates, 
the system turns to a state of the type {S; x^), and S remains fixed from that stage 
on forever. 

When the state at time t is (N;x^), unless a deviation of S occurs, the game 
played at time t + 1 is V{N;x^), whose grand coalition is A^. At this time the 
allocation is xf,^^. However, if S deviates, the game played at time t + 1 is V{S] Xg), 
where Xg is the allocation induced by x^ to coalition S. At time t + 1 the allocation 
is xf_^i and the subsequent game is V{S; xf_^i) whose grand coalition is 5*. 

For the sake of simplicity we assume a Markovian structure of the game, where 
the stage game played at time t depends on the allocation at time t — 1. More 
complicated dynamics could be considered, for instance the game at time t could 
depend on the whole past history. An interesting intermediate case is the one where 
the game depends on some unidimensional function of the history, for instance on 
the sum of the past allocations. Think for instance of a model of dynamic public 
good provision, where every player contributes to a public good, whose level at time 
t depends on the (discounted) sum of past contributions. 

A few remarks regarding our modeling choices are in place. Up to Section [6l we 
assume that once a coalition deviates, it remains the grand coalition forever and no 
further splitting off of sub-coalitions will take place. This restriction corresponds to 
the first two types of core solutions, that are concerned with long-term plans that 
prevent these kind of deviations. When dealing with the third type of core solution 
we lift this restriction. A deviating coalition is not protected against coups of its 
sub-coalitions. This is the reason why a threat of a coalition to deviate is rendered 
credible only if it is immunized against further split offs of its sub-coalitions. 

We also assume here that once a coalition deviates, there will be no way to restore 
a full cooperation and to rebuild the grand coalition A^. Such a possibility requires 
a much more complicated dynamic that would depend also on past allocations of 
non-deviating members. In this paper we decide to keep matters as simple as possi- 
ble. This distinguishes our model from the literature on coalition formation that we 
mentioned in the Introduction. 

In our model a coalition S can deviate prior to time 1 and play the game ff . We 
could as well assume that at time 1 for any S, V{N,Xq){S) = V{S,Xq){S), and it 
will make no difference in the results. Note however, that in the motivating example, 
when the grand coalition is A^, the worth of S is typically different from its worth 



when the grand coahtion is S. 

Our model refers to the deviating coahtion, but it ignores the rest of the players. 
In principle, the complement of a deviating coalition could be treated just like the 
deviating coalition itself. The continuation game of the complement depends on its 
historical allocations. However, we chose not to specify it for two reasons. First, 
our study focuses on two main aspects, fairness and stability. Whether or not a 
coalition is treated equitably does not depend on what happens to its complement. 
The same applies to the willingness of a coalition to split off: it is not affected by the 
its complement. 

The second reason is that we study core solutions and characterize the games 
whose core is non-empty. In these games no deviation will occur and in any case no 
coalition will be left alone without its complement. 

3.2 Discounting future payoffs 

We assume throughout that all players have the same discount factor < S < 1. 
Suppose that player i's payoff at time t is Xt{i). Her present normalized payoff is 



oo 






We define for every T <Z N 

x^{T,6) = y^a:»(i,(5). 

i€T 

Therefore a;*(T, 6) is the sum of all individual allocations of T's members. 
Define a new characteristic function on N as follows. 

f * (S*, 6) = max x* {S,5), 

where the maximum is taken over all feasible histories of S'-allocations: a;f,a:f, . . . 
and Xt{i) = x^{i). 

The dynamic game with discount factor 5 will be denoted by (V", 5). 

4 The fair and stable core solutions 

4.1 The fair core 

There are two justifications for the definition of core in the classical model of one-shot 
cooperative game. The first is fairness and the second is stability. An allocation is 
in the core if any coalition obtains at least its worth. Behind this justification lies 
an assumptions that a central planner has a full control on what the players get, and 
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once she makes up her mind regarding the spht of the cake, the players have no way 
to protest. 

This kind of reasoning leads us to define what we call the 'fair core' first. A 
sequence of allocations a;^,x^,... is in the fair core if fore every coalition S the 
present value of the shares of S exceeds the present value of the worths of S. It 
is assumed that coalition S can do nothing about its future shares, which gives the 
central planner the freedom to choose allocations without paying attention to semi- 
strategic considerations like stability. 

The definition of fair core is concerned solely with the following consideration: it 
is fair to give coalition S allocations whose present value is no less than what their 
present worth is. 

Definition 4.1 (Fair core), (i) A sequence of A^-allocations Xi ,X2 , ■ ■ ■ is in the 
fair core of (V, 6) if for every S* C iV 



xf (5, 5)>il-5)T 5'~'ViN; xl,)iS). 



,'> /■] I ^^ I I — /■] I , 



(ii) A sequence of A^-allocations x'^ , x^, ... is in the e-fair core of (V", 6) if for every 

S CN 



^{S,5)>il-5)J2s'''V{N;xl,)iS)-e. 



X ^ , , _ ^ 

If the core of the stage game at time t is nonempty, for every t, then the fair core 
of {V,6) is nonempty. 

Example 4.2. It is possible for a game {V, 6) to have a nonempty fair core even if 
for every t the core at the stage game is empty. Consider the four player games Ui 
and U2, where Ui{i) = for every player i, ■Ui(12) = ■Ui(23) = 'Ui(13) = 3, ^1(123) = 4 
and player 4 is dummy; game U2 is like the Ui where players 1 and 4 exchange their 
roles. The cores of Ui and U2 are empty. 

Suppose that v^ = Ui, V{N; (1, |, |, 0)) = U2 and V{N; (0, |, |, 1)) = Ui. Suppose 
that xf = {1, |, |, 0) when t is odd and xf = (0, |, |, 1) when t is even. The result is 
that Ml is played in odd times and U2 in even times. 

When the discount factor 6 is high, the average over time of stage games is close to 
{ui + U2)/2 and the discounted value of the stream of allocations is close to (|, |, |, |). 
Thus the sequence of payoffs {x'^)t is in the e-fair core of {V, S). 

Definition 4.3 (Efficiency). A sequence of A^-allocations x^,X2,--- is efficient in 
(V, 6) if 

x^{N,6)>v,{N,6). 
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That is, x'^ ,X2 , ... is efficient if the present value of the grand coahtion's share 
is the maximum available. Recall that the actual game is history dependent. While 
any of the stage allocations could be locally efficient, it might reduce the size of the 
cake in subsequent periods and thereby might hamper efficiency. 

In the classical one-shot game the definition of allocation contains the requirement 
of efficiency. This is not the case in the dynamic game. The fair core is not necessarily 
efficient, as demonstrated by the following example. 

Example 4.4. Suppose that 

I otherwise. 

and, if the allocation x^ is uniform (i.e., treats all players equally), then V{N; x^) = 
|a;^|fj^, where |x^| stands for the sum of the individual allocations of all players, 
otherwise V{N; x^) = 0. Call Ci = (1, 0, . . . , 0) G M^ the ffist vector of the stan- 
dard basis and = (0, . . . , 0) G M^ the zero vector. The sequence of allocations 

—)■—)■ 
ei, , , . . . is in the fair core: the ffist allocation ei is in the core of the stage game 

v^ , but it is not uniform and therefore all subsequent games are identically 0. This 
sequence is in the fair core of (V, S), but it is certainly not efficient. 

Definition 4.5 (Efficient fair core), (i) A sequence of A^-allocations x^ ,X2 , ... is 

in the efficient fair core of {V, 6) if it is efficient and in the fair core of {V, 6). 

(ii) A sequence of A^-allocations Xi , x^, ... is in the e-efficient fair core of {V, 6) if 
it is efficient and in the e-fair core of {V, 6). 

In the special case where the worth of the grand coalition is constant, that is when 
the worth of the grand coalition in all stage games do not depend on the history of 
allocation nor on the time, the fair core and the efficient fair core coincide. 

4.2 The stable core 

The definition of the fair core does not make use of the entire structure of the dynamic 
game. It uses only states of the type (A^;x^) and not of the type {S;x^), where 

The second justification of the core involves stability considerations. An under- 
treated coalition might deviate, create its own game, and improve its position by 
reallocating its endowment. When a coalition S threatens to deviate, it shifts the 
system to a state of the form {S;x^) and the dynamic then is governed by V{S] ■). 
This is why referring just to states of the type [N; x^) is insufficient and there is a 
need to refer to states of the form {S; x^) for every coalition S. 
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Let x]^, x^, . . . be a sequence of allocations. Define 

oo 
t=h 

The number x^{i^5) represents the discounted value at time h of the shares that 
player i receives at time h and on. In particular, x^:{i^5) = xl{i,S). Similarly, define 
the game v^{-,6) as 

v'^{S,6) = max^a;^(i,(5), 

ies 

where the maximum is taken over all feasible sequences x^ , x^, . . . xj^, -zf+i, -2^+2 • • • 
that coincide with x^, x^, . . . up to /i, the time when S decides to leave. 

A sequence of allocations Xi , x^, ... is in the stable core if at any time h the value 
of the shares of coalition S exceeds the value of what coalition S could guarantee in 
autarky, meaning without being engaged with others. 

Definition 4.6 (Stable core), (i) A sequence of iV-allocations xi,X2, ... is in the 
stable core of (V, S) if for every S (^ N and every h, 

x':is,5)>v::is,6). 

(ii) A sequence of iV-allocations x^,x^,... is in the e-stable core of {V,6) if for 
every S (^ N and every h, 

x':iS,5)>v^iS,S)-e. 

Remark 4.7. (a) Unlike the fair core, any history of A^-allocations in the stable core 
is efficient. 

(b) The two notions of core are not necessarily co- variant with linear transformations. 
If V is CO- variant with linear transformations, so are the two cores. 

Example 4.8. It is possible for a game {V, 6) to have a nonempty stable core even if 
for every t the core of the stage game is empty. Consider a set A^ = {1, 2, ... ,2k + 1}, 
and let 

I otherwise. 

be x^{N) times a majority game, and let V{S]x^)(T) = 2~^'^^V{N; ■)(T) for every 
S'^N. 

The core of each stage game V{N; xf) is empty, and so is the fair core of (V", 5), 
whereas its stable core is not, regardless of the discount factor. The reason being 
that when a coalition deviates, its future payoff declines rapidly. Coalitions will be 
satisffed with shares that are strictly smaller than their worth, because deviation does 
not promise a greater portion. 
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5 Non-emptyness of the core 

5.1 Non-emptyness of the fair core 

The following result applies to games where v{N; x^){N) is equal to x^{N) for every 
allocation x^ . 

For the next definition we recall that the set of characteristic functions is a vector 
space. Denote by A{d) the set of stage allocations of games where the worth of the 
grand coalition is d. That is, A((i) = {a;^;a;^(A^) = d,x^{i) > B for every i G A^}. 
The set A((i) is obviously compact, which is the reason why we impose the constraint 
that x^{i) > B for every i & N . 

Let X G A((i) be an allocation. We say that (yi, . . . , y^; ai, . . . , a^) is a split of x, 
if 

k 

where Uj > 0, Yli=i % ~ -'-' ^^"^ Vj ^^ ^^ allocation j = 1, . . . ,k. That is, x is a convex 
combination of the allocations i/j G A{d) with aj being the respective weights. 

Definition 5.1. The convexification of V{N; ■), denoted conv V^(A^; ■), is a correspon- 
dence defined as follows. Let x G A((i) be an allocation. Then, conv V^(A^; x) is the set 
of all games that can be expressed as X]7=i ctjViN, yj), where (yi, . . . ^y^] ai, . . . , a^) 
is a split of X. 

If V{N\ ■) is continuous, then conv V"(A^;x) is closed and therefore, conv V(A^;x) 
also contains all games of the form Xlyli '^i^(-^j %)' where x is expressed as an 
infinite convex combination of allocations: x = X^^i '^jVj- 

Theorem 5.2. Consider a game where V{N, ■){N) = d and V{N; ■) is continuous. 
Assume that for every coalition S, V{N; ■){S) is bounded. For every e > there is 
< 5o < 1 such that for every 6 G {6o, 1) the e-fair core of (V, 5) is not empty if and 
only if there exists x G A((i) and v G conv V{N; x) such that x is in the core of v. 

Before we get to the proof we wish to comment on the contents of this theorem. 
Just like in the folk theorem of the non-cooperative game theory, it characterizes 
the solution of the dynamic game in static terms. Specifically, it characterizes when 
the £-fair core of the dynamic game is not empty in terms of the convexification of 
V{N-.). 

Note that we refer to the e-fair core rather than to the fair core. The question is 
whether we do it because we just cannot prove anything stronger, or that it is due 
to a structural insurmountable difficulty. Recall that the dynamic game is described 
by the dynamics, V and by an initial game played at the first stage. While there is 
some control of future games through past allocations, there is no way to alter the 
initial game. It might happen that this stage-game hinders the existence of an exact 
core while e-fair core does exist. 
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Proof of Theorem \5.B. Suppose first that for every £ > tliere is 1 > (5o > sucli 
tliat for every 5 G ((5o, 1) there is a sequence a:i,X2, ... of allocations in the e-fair core 

Denoting, 



x = {l-6)^6'-^Xt and u = {I - 6)Y^6'-W{N-xt-i), 
t=i t=i 

we have for every S* C A^, 

oo 

:{S) >{1-6)J2 S'-'V{N; Xt^i){S) - e = u{S) - e. 



t=i 



Here, V{N]Xq) denotes the initial game, Vi. 

Note that (1 - 5) Y.T=2 5^~^V{N] xt-i) = u{S) - (1 - 5)vi, and we obtain 

x{S) > u{S) - (1 - 6)vi{S) + (1 - 6)vi{S) - e 

oo 

= {1-6)J2 S'-'V{N; xt-i) + (1 - 6)v,iS) - e 

oo 

>(l-<5)5^(5*-V(iV;Xi_i)-£. 
When 5 is sufficiently close to 1, since V{N\ ■)('S') is bounded, we have 

_j j~ oo _. J-- oo 



Thus, 



t=2 t=2 



x(^)>(l-(5)5;](5*-V(iV;Xi_i)-£ 

t=2 

= b^-Y,b'-^V{N-x,,^){S)-e 

t=2 

>^-$^5*-V(iV;x,_i)(5)-2^- 

t=2 



Define 



\-b "^ 



a; 



^ .^2 
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$^<5*-V,. 



If S is sufficiently large, for every S, \x{S) — x'{S)\ < e, and therefore, 



x'{S) > 



1-6 



J2S'''V{N;xt^^){S)-3e. 



t=2 



In other words, x' is in the Se-core of the game 



1-^ 
6 



X;<5*-V(iv;x,_i; 



t=2 



which is a (infinite) convex combination of the games V{N; Xt-i),t = 2, 
the weight 

rt-l-'- - ^ _ rf-2/ 



each with 



5' 



6 



6'-'{l-S) 



and is therefore in convy(A^; x') (because x' is a convex combination of Xt-is with 
the weights 6^-\l - 5), t = 2, 3, . . . )• 

Since e is arbitrary, from compactness and continuity of V{N] ■), we conclude that 
there exists v G conv V{N; x) such that x is in the core v, as desired. 

We now assume that there is a vector a; e A such that x is in the core of f G 
conv V{N; x). By definition of conv V{N; x), there is a split (?/i, . . . ,yk; cti, . . . , ak) of 
X such that 

a^V{N; i/i) + ■ ■ ■ + «A:^(iV; y,) = v. (5.2) 

Fix an e > 0. For S large enough one can divide the set of periods into k disjoint sets 
T^, . . . , T'^ in a way that for every j = 1, . . . ,k, 



a-' 



(1 - 5) E ^'" 



(5.3) 



t£Tl 



(see for instance, iFudenberg and MaskinI (jl986l )). 

At time 1 set Vi as an arbitrary game where Vi{N) = d. And in general, for t G T^ 
define Xt = Vj- In words, over the time periods in the set T^ the allocation is t/j and 
the game that follows is V{N;yj). Note that since V{N;yj){N) is fixed and equal 
to d, for every i = 1, ... ,k, yi is an allocation of V{N; yj) (because yi G A((i)). By 
construction and (15. ip the present value of allocations is x. 

On the other hand, the present value of all the stage games is 



k k 

(l-(5)t;i+E(l-(5) Y. ^'~'V{N-Xt-i) = {l-5)vr+Y,{^-^) 






V{N;y,) 
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Let jo be such that 1 G T^°. Using (15 .Sp we obtain for every coahtion S, 

k 

k 

= (1 - 6)v,{S) + Y, a,V{N; y^){S) - (1 - 6)V{N; y,,){S) 
i=i 

k 

i=i 

As V(N; ■) is continuous, V(N; x)(S) is bounded and therefore, when S is sufficiently 
close to 1, (1 — 6)vi{S) < e for every coalition S. Thus, the present value for every 
coalition S satisfies, 

k 

((1 - 5K + 5^(1 - 5) Y. S'-'V{N;x,^,)yS)<v{S) + e. 

Since x is in the core of f , the sequence Xi, 0:2, . . . is in the e-fair core of the dynamic 
game V'^ with the discount factor 5. D D 

Example 5.3. Let N = {1,2,3} and let Cj be the i-th vector of the standard basis 
in M^, that is, its z-th coordinate is 1 and the others are 0. Define V{N, Cj) to be 
the additive game where v{j) = 1/2 for j ^ i and v{i) = 0, which we denote as 
p_j. When X = {x^,x'^,x^) is such that x* < 4/5 for every i E N, then V{N,x) is 
the simple majority game (i.e., V{N,Xq){S) = 1 iff 15*1 > 2). Moreover V{N,-) is 
extended to the whole simplex in a continuous fashion, keeping V{N, ■){N) = 1. Note 
that in all the games involved, the feasible allocations are elements of the simplex 
{(x\ x^, x^) : X* > 0, J2i ^* = !}• 

Let Vi, the initial game, be the simple majority game. Set, Xi = ei, X2 = 62 ancu 
xt = et(mod3)- The dynamic induces: V2 = V{N,xi) = p_i, V3 = V{N,X2) = P-2, 
and Vt = V{N,X2) = P-(t-i)(mod 3)- It turns out that when t > 1 the core of Vt is 
non-empty. However, if the allocation at time t is the unique core allocation of Vt, 
the next stage-game is the majority game, whose core is empty. 

It is easy to check that Xi,X2, . . . is in the e-fair core for discount factors large 
enough. To see that the dynamical game satisfies the sufficient condition of Theorem 
15. 2[ consider x = (1/3, 1/3, 1/3). Let v be the additive game with weights 1/3 assigned 
to each player. Note that 

(a) X is in the core of v; 

(b) J2i=i \^i is a split of x and 



^Here, 3fc(mod 3) = 3. 
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(c) v = ElilP-^ = ElilViN,e,). 



Thus the sufficient condition of Theorem 15.21 is satisfied. 

Let M be a closed set of allocations. For a vector x define convjv/ V{N; x) as 
convV^^(x) was defined, with the extra condition that the allocations t/j are in 
convM. That is, conv mV{N;x) is the set all games that can be expressed as 
'E^j=iajV{N;yj), where {yi, . . . ,yk;ai, . . . ,ak) is a split of x and yj G convM, 
j = l,...,/c. 

Theorem 5.4. Consider a game where V{N; ■) is continuous and bounded. For'-/ > 
denote M^ = {x; V{N;x){N) > snpyV{N;y){N) - 7}. For any e > the efficient 
e-fair core of a game V{N; ■) is not empty for 6 large enough if and only if for every 
7 sufficiently small there exists x and v G couva/^ V{N; x) such that x is in the '-/-core 
ofv. 

The proof is similar to the proof of Theorem 15.21 and is therefore omitted. 

5.2 Non-emptyness of the stable core 

Recall that V{S; x''^) is the stage game played with S as the grand coalition after 
a stage in which the allocation was x^ . We now assume that V{S;x){T) depends 
on x^{T) = YlieT^i ^°^ every S that contains T in a continuous and monotonically 
increasing fashion. In particular, the worth of coalition T C S* at time t depends 
only on its total share at time t — 1. For every coalition T and time t, we define 
f/^(c), inductively. U^{c) = V{S;x)(T), where x{T) = c. Note that this is well 
defined, as V{S;x)(T) depends solely on x(T). Then, U^{c) = U^{U!f^{c)). Define 
/r(c) to be the limit of U^{c). Due to continuity this limit exists. Thus, it satisfies 
/t(c) = fTifric)). That is, /r(c) is a fixed point of U^ and of /y. 

We further assume that /r(c) is finite for every T and c, which in equivalent to 
assuming that either the set of fixed points of U^ is unbounded or f/y(x) < x for x 
sufficiently large o 

Let X be an allocation of vi and define the characteristic function Ux as follows: 
Ux(T) = fT{x{T)) for every coalition T. 

Lemma 5.5. For every e > there exists a time m such that for every c < Vi{N), 
T C N and an allocation x of vi with x{T) = c, \ux(T) — U^{c)\ < e for every t >m. 



^The function U]p is continuous and monotonic. In case the set of the fixed points of C/^ is 
unbounded, every non-fixed point of U]. is between two fixed points. The set of fixed points of U]. 
is closed, and therefore for every non-fixed point of U^, say c, there are two closest fixed point, 
one above c and one below it. The sequence U\.{c) then converges to one of the two (depending 
on whether U^{c) > c or U^{c) < c). If, however, the set of fixed points of U^ is bounded, 
then the sequence U^{c) diverges to infinity in case U^{c) > c asymptotically. In case t/^(c) < c 
asymptotically, the sequence U^{c) is decreasing and fric) is finite. 
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Proof. Fix e > and a coalition T. Denote by F the set of fixed points of V{S; x){T) 
in the interval [0,fi(A^)]. Let S be a finite subset of F having the property that for 
every a E F there is b E B such that |a — 6| < e. Since V{S;x)(T) is continuous 
and monotonically increasing in x{T), fx is monotonically increasing. Thus, frio) £ 
[61,62], for every a G [61,62] with 61,62 G B. Moreover, the distance |/T(a) — U^{a)\ 
is decreasing with t. Denote by A{h) the set of all points that are absorbed to b E B. 
That is, A{b) = {a: /^(a) = 6}. 

For every b E B, there is time rrif, such that \b — U^{a)\ < e for every t > mf, and 
a E A{b). Let mx = niax{?7ib: 6 E B}. Thus, for every a E [0,fi(iV)], either a E A{b) 
for some 6 G -B, in which case |/t(o) — tZ-f (a)| = |6 — Ux{ci)\ < e for every t > itit, or 
\a — /T(fl)| < If^Tl*^) ~ fT{0')\ < £ for every t. Since there are finitely many coalitions, 
m = max{?7iT : T C A^} satisfies the assertion of the lemma. D D 

Theorem 5.6. Consider a game where V{S;x){T) is continuously determined by 
x{T) in an increasingly monotonic fashion. Assume furthermore, thatV{N;x){N) = 
Vi{N) = 1 when x{N) = Vi{N). Then, the two following statements are equivalent: 

(i) For any e > there is 6q < 1 such that for every 6 E [6q, 1) the e-stable core of 
a game {V, 6) is not empty. 

(ii) For every e > there exists an allocation x of vi such that the e-core of u^ is 
not empty. 

Before we proceed to the proof of this theorem, we need an auxiliary result. Let 
ai,a2,... be a bounded sequence of numbers. For any integer h denote, a^'^ = 
(1 — 6) Yl'^h ^^~^cit- The proof of Theorem 15.61 uses the following lemma. 

Lemma 5.7. For every 6 < 1 large enough and every bounded sequence of numbers 
ai, a2, . . . such that {a^'^jh has an accumulation point a > 0, and every 7 > there 
is a time h such that a^ > a — '-/, while a^ < a + 7. 

Proof. For every hi < /i2, 

h2 — l / 00 \ 

[1-6)^2 ^*"''«* + il-5)ll-J2 ^''' «*'''• (5-4) 

t=hi \ t=h2 J 



a^'^ 



We assume that the sequence ai, 02, . . . is bounded by M > 1. Since a is an accumu- 
lation point, there are hi < /12 such that 

V 5'-^' > 1 - — and lay - al < -, for h = hi, /i2. 

t=hi 

We consider the greatest h, hi < h < h2 such that at > a — •j. There exists such 
h because if all h between hi and /i2 satisfy ah < a ~ 'j, then 

a^ < (1- -?-)(a --/]+ -?-M < a - ^ 



:)(a-7) + 



2M'' '/ 2M 2 



which contradicts the choice of hi. 

As for a^, fl5.4p apphed to h = hi and to /i2 imphes that 

h'z — l / oo 

t=h \ t=h2 

h2-l 



<{l-6)a, + {l-6) J2 5*-'(a-7) + (l-^) l-E^*"M(« + ^/2)- 



t=h+l \ t=h2 



When 6 is large enough, (1 — 5)ah < 7/2. Thus, a'^'^ < 7/2 + 5{a + 7/2) < a + 7, as 
desired. D D 

Proof of Theore'm \5.6\ . We assume without loss of generality that vi{N) = 1. We 
prove that 1^ implies ([n]). We assume that for any e > the e-stable core of (V, 6) is 
not empty for S sufficiently large. Fix e > and assume that 1 — e < 6. 

Let m be the one guaranteed by Lemma 15.51 and e. Suppose that the discount 
factor 6 is large enough so the total payoff of any coalition during m periods could 
not exceed e. 

Let Xi,X2, ■ ■ ■ be in the e-stable core of {V, 6) and let x* be an accumulation point 
of the sequence x^ = x^((5) = (1 — S) Yl'^h ^^'^^t, h = 1,2. . . . (it exists because, by 
assumption, the sequence of allocations is bounded). 

By assumption, Xi(A^) = X2{N) = . . . . We will show that x* is in the 5£-core 
of Ux,. If not, then there is a coalition T such that x*(T) < Ux,{T) — 5e. In par- 
ticular, x*(T) is not a fixed point of fx- Since for every time h, x^ is an average of 
Xhi^h+i, . . . , we have that x{N) := x^{N) = V{N,Xt){N) = Vi{N) (the last equality 
is by assumption) for every period t, implying that x* is an allocation of Vi. 

Since the set of fixed points of fx is closed, and x*(T) is not a fixed point of fx, 
one can find /3 > such that 

xt(r) > x,(r) - /3 implies /t(x^(T)) > /t(x*(T)). (5.5) 

The reason is that when x'l{T) is not a fixed point of fx, there is an open interval 
around x'l{T), whose points have all the same range as x^(T). That is, fx is fixed 
around x^(T). Thus, there is (3 > such that x^(T) > x=k(T) — (3 implies fx{x^{T)) = 
/r(x^,(T)). In case x^(T) > x*(T), then by monotonicity fx{x^{T)) > fx{x^(T)) and 
therefore, (15. 5p . 

Applying Lemma EZ] to the sequence Xi(T), X2(T), . . . and the accumulation point 
x*(T), we obtain that for 7 = min(/3,£:), there is a time h such that 

Xh{T) > x,(T) - 7 and x^(T) < x,(T) + 7. (5.6) 

In words, the instantaneous payoffs of coalition T at time h is greater than x*(T) — 7, 
while the present value of coalition T's payoff at time h + 1 is less than x*(T) + 7. 
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We now describe a deviation of coalition T. At time h + 1 coalition T deviates and 
plays the game V{T,Xh{T)). From time h + 2 on, any allocation of the stage-game 
is fine. After m periods the worth of the coalition T in the stage-game, is by Lemma 
15. 5[ close to Ux^{T) up to e. Since the first m periods after h contribute at most e 
to the entire present value of coalition T, the payoff (discounted to time h + 1) for T 
due to the deviation is at least Ux,XT) — 2e. 

By O, Xh{T) > a;,(T) - 7 > a;,(T) - /3. Because of ([S3]), u^S^) > u^XT)- 
Thus, due to the deviation, the payoff of coalition T is at least u^^iT) — 2e. However, 
the sequence a;i,X2, ... is in the e-stable core of (y,6), and therefore, by deviating 
coalition T cannot get more than e beyond the originally planned payoff (a:^^^(T)). 
Thus, 

Ux,iT)-2e<x':+\T)+e. (5.7) 

Again from (15.61) we have a;^(T) < x^,(T) + 7 < x^:{T) + e. Thus, 



>+i 



(T)<x^(T)+e<x,(T) + 2£. (5.^ 



The first inequality of (15. 8p is due to the fact that 1 — 5 < e (as assumed at 
the beginning of the proof) and Xh(T) < vi{N) = 1. Hence, by (15. 7p and (15. Sp . 
Ux,{T) -2€ < x'l+^T) + e < x*(T) + 3e. It implies that Mx*(T) - 5e < x*(T). This 
is a contradiction, and therefore x=k is the 5£:-core of Ux, ■ 

The proof that ([11]) implies ([1]) is relatively easy and is therefore omitted. D D 

Remark 5.8. Assertion (jn]) of Theorem 15.61 states that for every e > there exists 
an allocation x of Vi such that the e-core of u^ is not empty. Due to lack of continuity 
it is impossible to conclude that there exists an allocation x of Vi such that the core 
of Ux is not empty. This is so because when a sequence of allocations of f 1, say {xk)k 
(each in the e-core of the respective Ux^), is converging to x, there is no guarantee 
that Ux^. converges to Ux- 

6 The credible core 

The third type of core we are about to define is close in spirit to subgame perfect 
equilibrium in the theory of non-cooperative games. A dissatisfied coalition may 
deviate at any time in which future allocations guarantee less than it can do alone. 
Hence, stability conditions must be preserved not only at the beginning of the game, 
but throughout the entire game. But when creating its own game, a coalition, say 
S may face a threat from one of its sub-coalitions, say T. The game established by 
T may depend on the entire history of allocations, starting from the grand coalition 
allocation at the beginning of game, continuing with S'-allocation and ending with 
allocations of its own. 

The game may start with the grand coalition, run this way for a while and only 
then coalition 5*1 may decide to deviate, run for a while and then coalition ^2 may 
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deviate etc. Thus, histories now consist of x^ ^x^ ^ . . . ,X(*, where Si = N and the 
sequence of Si is decreasing (w.r.t. inclusion). A history x^^,X2'^, ■ ■ ■ ,a;f' is feasible 
if at any time t, x^' is an allocation of the stage game V^*{x^^~i^). 

A central planner has an allocation policy, denoted a, that associates with any 
time and any possible instantaneous game an allocation. In other words, the central 
planner has a full contingency plan as to how the available cake should be split at any 
point in time. Formally, the allocation policy a is such that a(x/) is an allocation of 
the game V{St+i:,xf^). 

After any history of allocations, x^ ^ , Xg^ , . . . , x^ * , an allocation policy a determines 
uniquely a continuation stream of allocations: xfl^ = cr(xf'), x^2 = '^i^t+i)^ ^tc. We 
denote this continuation by Co-(xf^, Xg^, . . . , xf*). 

Definition 6.1 (Credible core). An allocation policy a is in the credible core with dis- 
count factor 6 oi (V, 6) if for every history X]^\ X2^ . . . , x^' the sequence Co-(X]^\x2^ . . . ,Xi*^ 
of allocations is in the stable core of V{St+i; xf'). 



A s imilar idea has been used in a non-cooperative context by iBernheim et al. 



(119871 ) ; IBernheim and Whinstod (119871 ) . These authors consider Nash equilibria that 
are immune from deviations not just of single players but also of coalitions. Not 
every deviation is acceptable, though: a deviation of some coalition has to be in turn 
immune from deviations of sub-coalitions. 

The main result of this section shows that a form of the on e -devia tion principle 



holds for the credible core. This principle goes back to iBlackwelll (119651) and h a s been 



widely used in extensive form noncooperative games. Recently IVartiainenI (120081 ) 
applied it in the study of coalition formation in a cooperative context. 

Definition 6.2. A coalition S Q St has a profitable one-deviation after the his- 
tory X]^^,X2^, . . . ,X(* from a, if there is an allocation x^^^ of 1^(5*; x^') such that 
the present value for coalition S of the sequence that starts at xf,_^ and continues 
with Co-(xi^, X2^, . . . , Xt\x^_^_i) is greater than the present value for S of the planned 
sequence Co-(X]^% X2% . . . , xf'). 

Theorem 6.3 (The one-deviation principle). An allocation policy a is in the credible 
core if and only if after every history x^ ^x^ ■,■ ■ ■ i^t^ and for every S C. St there is 
no profitable one- deviation. 

Proof. The 'only if direction is trivial. For the 'if part, assume that after every 
history X]^\ X2^, . . . ,Xj' and for every S C. St there is no profitable one-deviation. 
Suppose that there is a coalition S C. St that has a profitable deviation after the 
sequence xf\ Xg^, . . . , xf*. Denote the gain by a > 0. By continuity we may as- 
sume that this deviation consists of finite number stages. Consider the shortest 
deviation of S after x^^^Xg^, . . . ,Xj' that guarantees a gain of at least a. This de- 
viation is xf,_i, . . . , xf^^. It implies that the deviation xf,.]^, . . . , x^_^_^_-^ guarantees S 
less than a, meaning that the single deviation of 5* to xf,_^ after the entire history 
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x^^, Xg^, . . . , Xj *, xf,_]^, . . . , a;^£_i makes a positive gain for S. This shows that there 
is no profitable one-deviation, as this direction of the theorem claims. D D 

Note that the theorem does not say that when the allocation policy a is in the 
credible core, the instantaneous allocations are in the respective stage game. 

Remark 6.4. Theorem 16.31 holds also under a richer non-Markovian dynamic, where 
V depends on the entire history of allocations and not only on the last allocation. 

7 Final remarks 

We close the paper with some additional comments. 

More on the non-empty ness of the core 

Consider a game where V{N; ■){N) is constant. In addition assume that for every 
coalition S, V{N; ■){S) is bounded. The e-stable core with discount factor S is not 
empty if and only if the core oi v^,{-,6) is non-empty. 

No-short assumption 

Throughout the paper we assumed that the stage allocation, xf , satisfies two as- 
sumptions. First, the allocation of player i is at least her v{i), that is, xf (z) > B, 
and second, xf is locally efficient, that is, xf (5) = ff (5). This assumption assumes 
that the inter-temporal transfers are limited. That is B might be well below Vt{i) at 
a certain moment, but since the overall payoff in the entire dynamic game needs to 
be individually rational, the instantaneous payoffs need to be sometimes higher than 
the stage IR level. The technical advantage of these assumptions is that the set of 
possible allocations at any stage is compact. 

Random games 

We analyze games where the instantaneous game depends deterministically on the 
history. The issue of stochastic dynamic game where the stage games are endoge- 
nously determined remains open for further studies. 
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